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Abstract 

Listening to young children’s voices is an issue with increasing relevance for many 
researchers in the field of early childhood research. At the same time, teachers and 
researchers are faced with challenges to provide children with possibilities to 
express their notions, and to find ways of comprehending children’s voices. In our 
research we aim to provide a method for listening to, and analyzing young 
children’s voices on educational issues. In this article we describe a new step in our 
research in which we are dealing with the issues of validity and reliability for the 
evaluation of our coding system: is our coding system for analyzing young 
children’s voices valid and reliable? 
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Resumen 

Escuchar las voces de ninos pequenos es un tema de creciente relevancia para 
muchos investigadores en el campo de estudios sobre la infancia. A1 mismo tiempo, 
profesorado y personal investigador se encuentran con retos para dar a los ninos 
posibilidades de expresar sus nociones y encontrar formas de comprender sus voces. 
En nuestra investigacion nos proponemos proveer un metodo para escuchar y 
analizar las voces de los ninos acerca de temas educativos. En este artfculo 
describimos un nuevo paso en nuestra investigacion en la que estamos trabajando 
cuestiones de validez y fiabilidad para la evaluacion de un sistema de codificacion: 
Es nuestro sistema de codificacion para analizar las voces de los ninos valido y 
fiable? 


Palabras clave: voces infantiles, contexto educativo, sistema de codificacion, 
validez, fiabilidad. 
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L istening to children’s voices is becoming increasingly relevant for 
many researchers and practitioners in the field of early childhood. 
In addition to its practical importance, it is often related to the UN 
Convention on the Rights of the Child (1989) too. This convention 
advocates the rights of children to be heard as active citizens in all matters 
concerning them (e.g. Clark, Kjprholt & Moss, 2005; Formosinho & Araujo, 
2006). If we want to do justice to children’s perspectives in nowadays 
society, it is essential to listen to their voices. Researchers have to deal with 
many challenges and struggles in offering children possibilities to involve 
their perspectives in early childhood practices (Pascal & Bertram, 2009). 
The position ascribed to young children in society depends strongly on the 
prejudices and images present in society about children. In research the idea 
is put forward that the child we meet in our society, and hence in education 
as well, is in fact a construction based upon theory and prejudices (Engel, 
2005; Komulainen, 2007). Research revealed that teachers particularly have 
strong images about ‘the’ child (see for instance Seifert, 2000). 

In our research program we concentrate on the problem of how to 
relate properly to children in educational situations and we raised the 
question whether it is possible at all to identify young children’s own voices. 
Through qualitative studies we wanted to provide a scientific contribution to 
clarify this issue. First by developing a conceptual framework which 
describes the elements of young children’s voices, and secondly by building 
a valid and reliable coding system, appropriate for qualitatively analyzing 
their voices. 

In a previous project we described the construction of a method for 
researching the attribution of meaning to educational issues by children, 
aged 5 to 6, in school. We explored the concept of young children’s voices, 
and formulated indicators for the construct of voice and attribution of 
meaning. We carried out five case studies, and we set the first steps in 
developing a coding system for analyzing elements of young children’s 
voices (Tertoolen, van Oers, Geldens & Popeijus, 2012). In the present 
article we describe a new step in our research, in which we are dealing with 
the issues of validity and reliability of our coding system. 
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Theoretical background 

For a qualitative analysis of young children’s voices, we first have to define 
the construct of voice. In this we follow Bakhtin, who states that any word 
uttered by an individual is essentially inter-individual. An utterance can 
never be attributed to a single speaker, as there is always a (real or virtual) 
listener involved. So the word of a speaker is always half someone else's, 
according to Bakhtin (1981; see also Wertsch, 1991). 

In our research on young children’s voices, we focus on young children’s 
attributions of meaning in situations and events in school. In the speaking 
and acting of children, in interactions with peers and adults, we can see and 
hear attributions of meaning. We focus on individual children, as we see 
each individual as a ‘speaking personality’, using language as a way to 
express himself. So listening to individual children requires a method to gain 
insight in these children’s notions and opinions. At the same time, those 
children could never be isolated when we want to study them in an 
ecologically valid way. Hence, due attention is given in our research settings 
to the children’s real life contexts, in which teachers, peers and 
parents/caregivers are included as important others. 

Schematically, we summarize our conceptual framework as follows: 
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Figure 1. Conceptual framework: related elements in the construct of voice and 
attribution of meaning 


We ground the theoretical framework of our research in the cultural- 
historical activity theory. 
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People’s opinions are always influenced by social, cultural, biographical, 
and historical determinants (e.g. Bourdieu, 1991). Those opinions, expressed 
or voiced by an individual, are influenced by these determinants, as well as 
by actual context-related interactions. The acquisition of opinions occurs in 
interaction with others, in a dialogical process, in which the voices of others 
resound as well (Bakhtin, 1981; Wertsch, 2002). Komulainen (2007) states 
that children’s voices are to be understood as “multidimensional social 
constructions that are subject to change. At the same time ‘voices’ manifest 
discourses, practices, and contexts in which they occur” (p. 13). 

Children’s perspectives and images originate from historically developed 
local contexts - like the classroom or the play ground - in which others are 
also involved. In interpreting children’s expressions, this specific context 
needs to be taken into account (Christopher & Bickhard, 2007; Daniels & 
Edwards, 2009). In our research the context is the school context, in which 
peers and teachers are present too. In this specific context, significant others, 
like parents or caregivers, are relevant as well. Children’s opinions and their 
ways of expressing them, are influenced by children’s context-related 
interactions, but at same time by social, cultural, biographical, and historical 
determinants (e.g. Bronfenbrenner, 1979; Meadows, 2010). 

In our research we focus on voices, as manifested in expressions and 
attribution of meaning by young children, in the school context. We define 
attribution of meaning in this research as the way in which a child expresses 
his conceptions and values on three aspects he encounters in the daily 
practice of his educational setting: the activities, the organization in and 
around the classroom, and the roles of his teacher in the school context. 
Besides the verbal and non-verbal aspects of these voices or expressions, we 
also look for underlying elements like ‘thinking, feeling, and wanting’. 
These are elements of the subject’s personality and play their part in the 
acting person (Gonzalez Rey, 2008). Gonzalez Rey (2008) refers to thinking 
and feeling as categories of the acting personality uniting intellect and affect. 
Thinking and feeling can be considered as aspects of conation, a dimension 
of mental processes, having to do with striving and wanting (Reber & Reber, 
2001). Not only the content of what people tell one another counts, but how 
people interact with one another is important as well, especially when it 
comes to feelings and motives of people (Daniels & Edwards, 2009). 
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All the related elements in our construct of voice and attribution of 
meaning, as represented in Figure 1, are part of our data gathering. This 
conceptual framework is the foundation of our coding system for data 
collection and analysis. All elements in our construct of voice have a 
theoretical basis in cultural-historical activity theory. 


Research Method 

Our research contains five case studies. In each case study we listened to 
children, aged 5 to 6, in school in several settings, and we studied the 
dynamics of the specific school contexts the children are involved in. 
Conducting more case studies means gathering more data, which enables us 
to articulate the issues of validity and reliability in an accountable way. 
Using more settings in a case study may lead to more supportive or 
supplementary findings by triangulating the data (Yin, 2009). According to 
Yin (2009; p. 116), data triangulation contributes to the strength of construct 
validity as well, by providing several sources of evidence for the same 
researched phenomenon. We decided to order our case studies sequentially. 
Each new case study is built on and elaborates the outcomes of a previous 
case study. This results in a so called multiple case study with a qualitative- 
interpretative approach in a flexible design, and using multiple sources of 
evidence (Robson, 2002). 

First, we formulated sensitizing concepts with respect to major elements 
of the school context. In this context we considered the following concepts 
as our main domains for analysis: school activities, classroom organization, 
and teacher’s roles. Secondly, we analyzed the data, collected in the different 
cases, in a process of open coding, focusing on emerging concepts, and 
looking for the relationships among them (Glaser & Strauss, 1967; Strauss & 
Corbin, 1998). We attributed subcategories to the categories, drawing from 
our empirical observations. Children’s expressions (like commenting, 
adopting, narrating, et cetera) were considered as properties or dimensions of 
the subcategories. Each category, subcategory, and property has its own, 
written definition. Coding children’s expressions is consistently based on a 
coherent unit of expressions from the transcribed observations of the focal 
children in the case studies (Miles & Huberman, 1994). 

We considered the coding process as completed after analyzing five case 
studies, as we were unable to add new properties to our defined 
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subcategories, and so saturation had occurred (Glaser & Strauss, 1967; 
Strauss & Corbin, 1998). 

Data collection 

Based on the outcomes of a previous exploratory study, we planned a series 
of case studies with different children in different school contexts, looking 
for comparable as well as complementary findings (Tertoolen et. al., 2012). 
The child in our first, exploratory case study was Tom. 


Tom is 6;5 and attends a Roman-Catholic primary school in a little village in 
the south of the Netherlands (Limburg). Tom is a bit older than most of the 
children in his class but he is small and looks a bit younger. Tom has an 
older brother and sister at the same school and a little brother at home. His 
father and his mother both work half-time. 

Tom’s school bases its educational philosophy on ‘basic development’ 
which means a specific form of developmental education based on 
Vygotskian theory (see van Oers, 2009). Tom’s class has a teacher with 
many years of experience in educating young children, called Tessa. _ 


After the first case study we decided to have more than one child involved at 
the same time, so we would be able to get more detailed insight in the way 
conversations with others might influence a child’s expressions. Irfan and 
Margareta were the children in our next case studies. 


Irfan is 6;0 and attends a primary school in Amsterdam. Irfan has an older 
sister at the same school and a baby brother at home. His parents have a 
Moroccan background. His father works for a transport organization and his 
mother is a staff member. 

Margareta is 5;6 and attends the same school as Irfan. She is the only child 
of a Turkish father and a Dutch mother. Her father runs a local business. Her 
mother has an academic background. 

The school of Irfan and Margareta has a mixed population. Many children 
have (grand)parents who are born outside the Netherlands. Each class with 
young children has, besides a teacher, also a part time teacher-assistant. 
Much attention is paid to language stimulation and independent learning 
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(weekly tasks). Irfan’s and Margareta’s class has two part time teachers. One 
highly experienced teacher, Jona, and a teacher, Mandy, who is recently 
qualified. Ayla is the teacher-assistant. _ 


Finally we added another two case studies to our research: Lennart and 
Bernadette. 


Lennart is 6;6 and attends a Roman-Catholic primary school in Amstelveen 
(a suburban city near Amsterdam). Lennart is a bit older than the other 
children in his class, but he is quite small and looks younger. He has two 
younger brothers, who don’t attend school yet. His father and his mother 
both have an academic background. They both work half-time. 

Bernadette is 5;7 and attends the same school as Lennart. Bernadette is quite 
young, compared to the other children in her class, but she is tall and looks 
older. She has a half-sister, aged 15 (her father was married before), who is 
living with her own mother. Her father runs a local business and her mother 
has an academic background. They both work full-time. 

The primary school of Lennart and Bernadette has eight classes for young 
children (aged 4 to 6) and there are also equivalent classes for the older 
children. There are two school buildings on two locations. The classes for 
the children aged 10 to 12, are accommodated in another street, nearby the 
main building. Bernadette’s class has two part time teachers, both with many 
years of experience in educating young children: Cecile and Magda. During 
the research Magda was present on the last day. _ 


In the exploratory study (Tom) we used three different settings for 
observations, to achieve data triangulation: 

■ Regular classroom and school activities 

■ Playing school in a play area 

■ A semi-structured interview about school notions 

By regular classroom and school activities, we refer to the current classroom 
projects, consisting of learning contents and educational activities. Playing 
school in a play area was an arranged activity, offering children the 
opportunity for role-play. In a semi-structured interview the children 
responded to questions like: If it were up to you, how would your school 
look like? What would you prefer to do, if you had free choice of activity? 
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For the purpose of strengthening the reliability of our outcomes in 
subsequent case studies, we decided to add another two settings for 
observations in the next four case studies (Irfan, Margareta, Lennart, and 
Bernadette): 

■ Taking pictures in school and discussing them 

■ Talking about feelings in and on school 

We provided the children in our research with a single-use photo camera. 
Cameras offer children the possibility to respond in non-verbal ways to 
questions like: Can you show me what you think is important here in and 
around school? Thus asking explicitly for the children’s opinions on the 
subject ‘school’. The answers, consisting of series of photographs, were used 
later on to discuss their expressions (both verbal and non-verbal): which 
pictures they liked best, which pictures represented a story, which pictures 
showed what they didn’t like at school, et cetera (Clark, 2007). We also 
explicitly invited the children to respond to questions about their feelings in 
school. The questions, offered to them as propositions, were answered by the 
children by selecting a picture, like smileys, that represented their feelings 
best. Questions like: How do you feel when the teacher is helping you to 
perform a difficult task, are partly based on a pictorial scale of perceived 
competence and acceptance (Lewis & Lindsay, 2000), and a social- 
emotional task of affective labeling (Formosinho & Araujo, 2006). 

All observations of playing school in a play area, discussing pictures, 
talking about feelings, and a semi-structured interview, were videotaped. 

Data analysis 

All the observations of school activities and the videotapes were transcribed 
verbatim. Kwalitan (www.kwalitan.nl), a computer program, was used for 
the systematic comparative qualitative data analysis. This computer program 
is a tool, supporting researchers in entering, archiving and exploring data 
(e.g. looking for certain words), structuring documents (e.g. segmentation), 
organizing data (e.g. overviews of codes with frequencies), selecting extracts 
in documents, and describing the process of data analysis (e.g. in memos). 

Based on the data of the exploratory study we started to build a coding 
system in Kwalitan, following the basic assumptions of the grounded theory 
approach (Glaser & Strauss, 1967; Strauss & Corbin, 1998; Tertoolen et. al., 
2012). We defined our sensitizing concepts and labeled them as the three 
main categories in our coding system: school activities, classroom 
organization and teacher’s roles. A fourth category (Relations) was needed, 
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for describing the relations among focal children, peers and adults, besides 
the teacher (see Appendix A). 

After labeling the categories and subcategories of our coding system we 
defined properties as parts of the subcategories to code elements of young 
children’s acting. These codes are partly derived from the contexts of the 
children involved (in vivo codes) and partly from the studied literature 
(constructed codes). Those constructed codes are based on indicators, we 
have formulated, as possible manifestations of young children’s voices 
within the school context: 

• expressing feelings and choices 

• sharing ideas about competences and needs 

• showing knowledge by pointing out, investigating, confirming, opposing 

• intending to gain something related to others 
(Tertoolen et. al., 2012). 

Validity 

In this phase of our research we have been scaffolding our coding system, 
and in particular we wanted to pay attention to ecological and construct 
validity. To achieve ecological validity, we focused on young children’s 
attribution of meaning in situations and events in school that make sense to 
the children. We took care that the children were observed in their daily 
school context and were engaged in different naturalistic settings, e.g. daily 
classroom activities and (outside) play. To reach construct validity, we 
focused in our research on theoretically formulated constructs of young 
children’s voices and attribution of meaning. Moreover, we used multiple 
sources of evidence: playing school in the play area, taking pictures and 
discussing them, talking about feelings in and on school, and an interview 
about school notions. To strengthen construct validity further, we used these 
multiple sources of evidence during data collection for establishing a 
conceptually consistent chain of evidence (Yin, 2009). 

Reliability 

We also strengthened our chain of evidence by inviting two independent 
coders to go through the same analyzing and coding processes (Yin, 2009), 
with the help of the coding system, including definitions of main theoretical 
constructs. By pattern matching -comparing the outcomes of data analysis in 
the different case studies -we will look for convergence between the 
constructs voice and attribution of meaning in our case studies (Trochim, 
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2011). Both coders can be considered experts in the field, as they were 
teacher-trainers in early childhood at a university of applied sciences. 

Memos with definitions of the categories, subcategories and properties, 
and a written coding instruction were at the disposal of the coders. First, the 
two coders watched the videotapes to get acquainted with two children in 
their school context in different settings. Then there was a meeting in which 
the structure of the coding system and the written definitions were explained, 
and questions could be asked. Finally, examples of written observations 
from other case studies were presented to practice the coding procedure. We 
compared the outcomes of the coders with the results of the researcher’s 
coding processes, looking for similar and rival interpretations in coding on 
the three levels of our coding system, described as categories, subcategories, 
and properties (inter-coder reliability). These results were needed to 
strengthen the consistency of the coding system. 

To ensure reliability we also created a case study data base, consisting of 
the data and a case study protocol to be used for the analysis of the case 
studies. This protocol, consisting of notes, documents, tabular materials, et 
cetera, was discussed with the peer researchers every six weeks (peer 
debriefing). 


Results 

As to the issue of ecological validity, we took care that children were indeed 
observed in their everyday contexts and were engaged in different 
naturalistic settings. As for construct validation we used those different 
naturalistic settings as multiple sources of evidence for data triangulation, 
and we maintained a conceptually consistent chain of evidence during the 
whole process of data collection and analysis, with the help of theory-based 
categories and definitions that were available to the coders. 

To establish inter-coder reliability, two coders separately analyzed the 
videotaped observations of the children in two case studies: playing school 
in the play area, talking about feelings, and the semi-structured interview. 
The researchers’ theory-based coding system maximizes the chances that the 
coders indeed focused on phenomena that theoretically relate to the notion of 
voice. Comparing the results of these data analyses, we were looking for 
similar and rival interpretations in coding on the three levels of our coding 
system, described as categories, subcategories, and properties. 
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For the definition of reliability we follow Miles and Huberman (1994; p. 
63): the total number of similarities divided by the total number of 
similarities and differences in coding. A first data analysis by several 
observers, independently using the same coding system, should generate 
about 70% inter-coder reliability, according to Miles and Huberman (1994). 
We decided we would accept 70% of overall agreement in coding among the 
researcher and the coders, as a result of this first analysis. In Table 1 below 
(the left side: before adjustments) the results of the comparison of the first 
round of coding processes among the researcher (A) and the two coders (B 
and C) are presented. Looking at the results on the left side of Table 1, we 
see that at first we couldn’t meet our formulated standard of an overall 
agreement of 70%. Based on these outcomes we had to reconsider our 
coding system, definitely on the levels of subcategories and properties, 
which showed the lowest percentages of agreement. 

Table 1 

Comparison of the coding results among the researcher (A) and the coders (B and 
C) 


Settings Children Similarities in coding among A, B, and C in average 

percentages 


Before re-adjustments in After re-adjustments in the 
the coding system coding system 


A- 

A- 

B - 

A- 

A- 

A- 

B - 

A-B- 

B 

C 

C 

B-C 

B 

C 

C 

C 


Play area 

Lennart 

72% 

73% 

59% 

68% 






Bernadette 

62% 

64% 

40% 

55% 

92% 

92% 

83% 

89% 

Talking 

about 

Lennart 

61% 

64% 

56% 

60% 

88% 

84% 

77% 

83% 

feelings 

Bernadette 

80% 

56% 

69% 

68% 





Interviews 

Lennart 

68% 

68% 

19% 

51% 

88% 

87% 

73% 

83% 


Bernadette 

70% 

66% 

47% 

61% 










126 Tertoolen el al. - Children’s voices 


To improve our coding system, we first made a qualitative analysis of the 
found similar and rival interpretations in coding among the researcher and 
the two coders. 

On the first level of coding (categories) we found that the coders faced 
difficulties in deciding, which category was the most appropriate in coding 
expressions of the focal children, despite the instruction that more than one 
code could be assigned to a single expression of the children. 

Extract 1. Child Lennart. Context: Talking about feelings in and on school. 
Lennart and two peers have been instructed by the researcher. Each child has 
three little boxes with a sticker on it, showing a glad, sad, or neutral facial 
expression. After each proposition, read by the researcher, the children put a 
small card in one of the three boxes in front of them, choosing the box with 
the face that represented their feelings best. 

The observer starts this activity by explaining the used material and 
presenting an example: How do you feel about attending school? 


Talking about feelings in and on 

Category 

(Non) 

c 

Properties 


school by Lennart (L), with peers 

+ Subcat. 

Verbal 




Bernadette (B) and Jan (J), and the 

researcher 







1. L: 

(halfway the example to 

4 

11 

V 


Exchanging 

A 


J.) what are you going to 

do? 

1 

01 

V 


Judging 

B 

2. L: 

(gets up, sits down again, 
and is looking what B. is 
doing) 







3. L: 

I am going to do glad. 

1 

01 

V 

c 

Demonstrating 

A 



1 

01 

V 

c 

Demonstrating 

B 



4 

11 

V 

c 

Exchanging 

A 



4 

11 

V 

c 

Exchanging 

C 

4. L: 

(looking at the two peers 
and holding his card 

above the box with the 

neutral face) 







5. B: 

I am also going to do glad 
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6. J: me too 

(...) 

7 L: we all like school! 4 11 V Exchanging A 

4 11 V Exchanging B 

1 02 V Choosing C 

1 01 V Judging C 


Category 4: Relations. Subcategory 11: (with) Peers. 

Category 1: School activities. Subcategory 01: Knowledge & skills. 

Subcategory 02: Attitude 

C: Conation (feeling, wanting, thinking) 

Coding by researcher (A) and coders (B and C) 

Especially category 4 (Relations) caused entanglement, as there were almost 
always others (such as peers) involved. The coders found it difficult to 
decide when they should, or should not, assign codes (also) to this category 
(see Extract 1 line 1, 3 and 7). Another difficulty occurred in assigning codes 
to category 3 (Teacher’s roles). Codes were attributed only when the teacher 
was physically present and intervening in the situations the focal children 
were involved in. Despite the instructions, the coders were uncertain to 
attribute category 3 codes when the children were referring to the teacher, 
but the teacher was not present at the time. 

On the level of subcategories we faced a similar kind of coding difficulties. 
Knowledge & skills (subcategory 01) is nearly always related to certain 
behavior of the child (subcategory 02: Attitude). 

Extract 2. Child: Bernadette. Context: Playing school in the play area 
Bernadette is playing with Lennart, Jan, and Eliza outside the classroom in 
an area, which is furnished with a table and chairs and school material as 
books, paper, pencils, scissors, and glue. The children have decided what 
they needed to play school in that area, and together with the teacher they 
have brought in what they wanted to play with within that specific area. 
Bernadette has been busy making a drawing and asked Lennart what to do 
next, but Lennart walked away in the direction of the classroom. 
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Playing school in the play area by 
Bernadette (B), together with peers 
Lennart, Jan, and Eliza 

Category + 

Subcat. 

(Non) 

Verbal 

C 

Properties 


B: (puts her drawing in a little 

2 

04 

NV 


Following 

A 

basket with other ‘finished’ 

2 

03 

NV 


Accepting 

B 

drawings, and takes a new piece 
of paper) 

2 

04 

NV 


Following 

C 


Category 2: Classroom organization. Subcategory 03: Rules. Subcategory 
04: Routines 

Coding by researcher (A) and coders (B and C) 

Difficulties in choosing the appropriate subcategory in category 2 
(classroom organization) was even more obvious. Not knowing the specific 
school context, it is unfeasible for external coders to distinguish whether 
rules (subcategory 03) or routines (subcategory 04) are applicable (see 
Extract 2). 

On the level of properties we found that some properties were related too 
closely: e.g. commenting and judging (subcategory 01), preferring and 
choosing in subcategory 02 (see Extract 3, line 6), and accepting and 
adopting (subcategory 03). 

Extract 3. Child: Lennart. Context: Semi-structured interview on notions 
about school 

During the semi-structured interview with Lennart, Bernadette, and Jan, the 
children are allowed to work on some activity like making a drawing. The 
interview took place in the play area where the children played school. 
Lennart sees the letter box, which is also put in the play area to play school. 
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Interview on notions about school 

by Lennart (L), with peers 
Bernadette and Jan, and the 
researcher (R) 

Category + 

Subcat. 

(Non) 

Verbal 

c 

Properties 

1 . 

L: 

(shows the researcher the 

4 

13 

NV 


Demonstrating 

A 



letter box) 







2. 

L: 

this is really grade 3! 

1 

01 

V 


Commenting 

A 




1 

01 

V 


Commenting 

B 

3. 

L: 

(puts the letter case 









aside). 







4. 

L: 

this is fun! 

1 

02 

V 


Preferring 

A 




1 

02 

V 


Preferring 

C 

5. 

R: 

you could.... 







6. 

L: 

I like coloring a car! 

1 

02 

V 


Preferring 

A 




1 

02 

V 


Preferring 

B 




1 

02 

V 


Choosing 

C 


Category 4: Relations. Subcategory 13: (with) Others (including the 
researcher) 

Category 1: School activities. Subcategory 01: Knowledge & skills. 

Subcategory 02: Attitude 

Coding by researcher (A) and coders (B and C) 

Based on the results of this qualitative analysis we took the following 
measures. 

We created the possibility to add to all codes a relational component: P 
(for Peers), F (for Family), O (for Others, including the researcher), or a 
combination of P, F, and O. As a consequence we removed the separate 
category ‘relations’ (see Appendix B). 

We maintained the other three main categories, but redefined some 
subcategories. Category 1 (School activities) was transformed into ‘attitude 
towards school activities’, as attitude is always involved in the opinions 
children have about school (activities). Here we followed Vyverman and 
Vettenburg (2010), who advocate that affective, cognitive, as well as 
behavioral components are to be distinguished in using the concept attitude 
or opinion, referring to children. These three components became our 
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subcategories. Affect (subcategory 01) refers to the feelings and preferences 
children show. Cognition (subcategory 02) refers to the (intellectual) views 
and information children have. Finally, behavior (subcategory 03) refers to 
how children actually perform. 

We also decided to create two new subcategories for category 2 
(Classroom organization). Children are accepting and following rules and 
routines (subcategory 04: Adoption), or they re-adjust rules and routines 
(subcategory 05: Modification). 

We added characteristics to codes in category 3 (Teacher’s roles) 
referring to the kind of teacher’s involvement in children’s activities: i (child 
- teacher interaction), r (child taking the role of a teacher), and a (child 
expressing himself about the teacher, without the teacher being around). 

On the level of properties we decided to reduce or combine those 
properties which caused confusion by the coders, because they were related 
too closely. 

As a result of the re-adjustments in the coding system, we have rewritten 
our memos with all the definitions of the categories, subcategories, and the 
properties. We made a new instruction for the coders, in which we drew 
special attention to the intended hierarchy of the coding system. 

We decided to recode the three units from the data collection of the two 
case studies, which showed the lowest agreement percentages in the first 
coding process: play in the play area by Bernadette, talking about feelings, 
and the interview with Lennart. Following Miles and Huberman (1994; p. 
63), we decided to accept now an overall agreement of 80%, as a result of a 
second round of data analysis and coding. 

We show the results of the recoding process in percentages on inter-coder 
reliability in Table 1 (after re-adjustments, on the right side). 

Looking at the overall results in Table 1, we see that we met our 
formulated standard of an overall 80% agreement on all the recoded units. 
First on play in the play area by Bernadette (89%, was 55%), secondly on 
talking about feelings by Lennart (83%, was 60%), and finally on the 
interview with Lennart (83%, was 51%). 

The next step in our research was to look into the content of the results of 
the recoding process. Is our coding system appropriate to analyze elements 
of young children’s voices and link them to the indicators, derived from the 
studied literature, we have formulated before? 
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Extract 4. Child: Lennart. Context: Semi-structured interview about notions 
regarding school. The researcher is asking each child involved, what he or 
she would like to do most at school, and with whom. Lennart responds to the 
first question: ‘I like coloring a car’. 


Interview 

on notions about school 

Cat. 

+ 

(Non) 

c 

Properties and 

by 

Lennart (L), with peers 

Subcat. 

Verbal 


relations 


Bernadette and Jan (J), and the 

researcher (R) 







1 . 

R: 

and would you like to do 
it on your own or with 

other children? 







2. 

L: 

and we would like to do it 

1 

01 

V 

c 

Preferring 

P/O 



alone (taking a look at J.) 

1 

01 

V 

c 

Preferring 

P/O 




1 

01 

V 

c 

Preferring 

P/O 

3. 

R: 

the two of you together or 
the two of you alone? 







4. 

J: 

ehm... together. We 
alone together and 

nobody else 







5. 

R: 

the two of you, you mean 







6. 

L: 

yes, alone with us 

1 

03 

V 

c 

Showing 

P/O 




2 

04 

V 

c 

Accepting 

P/O 




1 

03 

V 

c 

Showing 

P/O 


Category 1: School activities. Subcategory 01: Affect. Category 2: 
Classroom organization. Subcategory 03: Adoption 
C: Conation (feeling, wanting, thinking) 

Relations: P (Peers) / O (Others, including the researcher) 

Coding by researcher (A) and coders (B and C) 

In Extract 4 we see an element of underlying expressions by Lennart, labeled 
‘preferring’ as a property of subcategory 01 (affect). In this extract Lennart 
is referring to himself and his friend Jan, speaking in a personal way: ‘we 
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would like’ (line 2). We see the same kind of expression in Extract 1, when 
Lennart is talking about going to school, including his peers Bernadette and 
Jan, by saying: ‘we all like school’ (line 7). He is referring to himself and 
what he likes in Extract 3: ‘I like coloring a car’ (line 6). At the same time 
Lennart expresses himself in Extract 4 about his choices, what he wants to 
achieve and the importance of the collaboration with peer Jan: ‘we would 
like to do it alone with us’ (line 2 and 6). 


Discussion and Conclusion 

In our research we had to deal with the issues of validity and reliability of a 
coding system for analyzing young children’s voices. We formulated the 
following question: Is our coding system for analyzing young children’s 
voices valid and reliable? On the basis of available data, we may conclude 
that we have been able to confirm the validity and reliability of the coding 
system. As for ecological validity, we observed children in their real school 
life context. As for construct validation we used multiple sources of 
evidence for data triangulation, and we maintained a conceptually consistent 
chain of evidence. The researchers reviewed drafts of the case study reports 
on a regular basis too (peer debriefing). The chain of evidence allowed two 
independent coders to go systematically through the same analyzing and 
coding processes (Yin, 2009). With an 80% agreement on coding among the 
researcher and two independent coders (see Table 1), we consider our coding 
system sufficiently reliable to analyze young children’s voices in more detail 
in the future. 

An important issue in researching the construct of voices, certainly with 
young children, is the role of the researcher and its potential bias. Most of 
the time during the research, the researcher remained a ‘marginal’ observer, 
registering the ways the children acted during all the occurring daily 
activities in school. However, the different roles of the researcher are, in 
fact, inseparable from the participating children in the research context 
(Holland, Renold, Ross & Hillman, 2010). There is not one or a simple 
solution to deal with this problem of potential bias. The only option is to use 
reflexive techniques, to explore the dynamics of the relationships between 
researcher and the ones involved in the research, according to Holland et al. 
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(2010). By arranging peer debriefing at a regular basis, cooperating with 
independent coders, presenting at adequate forums to develop and maintain a 
chain of evidence, and publishing in peer reviewed journals, we dealt with 
this methodological issue in the best possible way. 

In the next phase of our research we plan to use the results of the coding 
processes to analyze the contents of the children’s voices in our five case 
studies. What do the children in our case studies have to say about their 
educational contexts? What are their notions and their opinions? The 
outcomes of these analyses will then be used to make an overall comparative 
analysis on the content of the children’s voices in these five case studies. For 
now we can conclude that we can be confident that the coding system yields 
data that permit reliable and valid conclusions. 
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Appendixes 

Appendix A 

Coding system 1: Categories, subcategories, and properties used for 
coding children’s expressions 


Category 

Subcategory 

Properties 

NV V C 

1. School activities 

01. Knowledge & skills 

Commenting 

Cooperating 

Judging 

Demonstrating 

Suggesting 


02. Attitude 

Showing 

Collaborating 

Adjusting 

Rejecting 

Inviting 

Assigning 

Moving 

Choosing 

Helping 

Persisting 

Competing 

Postulating 

Preferring 

2. Classroom organization 

03. Rules 

Accepting 

Adopting 

Stepping over 

Rebelling 


04. Routines 

Following 

Fitting in 

3. Teacher’s roles 

05. Cultural Mediator 

Conveying 


06. Educator 

Sanctioning 

Confirming 

Passing on 

Correcting 

Attending 


07. Supporter 

Mediating 
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Category 

Subcategory 

Properties 

NV V C 



Equipping 

Connecting 

Paying attention 

Initiating 

Inquiring 

Assisting 


08. Manager 

Intervening 

Learning 

Adding 

Obliging 


09. Conversation partner 

Hearing out 


10. Designer 

Devising 

Preparing 

4. Relations 

11. (With) Peers 

Narrating 

Showing 

Demonstrating 

Inviting 

Role playing 

Interchanging 

Competing 

Rejecting 


12. (About) Family 

Narrating 

Showing 

Demonstrating 

Inviting 

Preferring 

Questioning 

Accepting 


13. (Towards) Others 

Narrating 

Showing 

Demonstrating 

Questioning 

Devising 

Mediating 


14. (On) Specific issues 

Narrating 

Showing 

Demonstrating 

Preferring 
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Note. Kinds of expressions: NV (non verbal) - V (verbal) - C (conation: feeling, 
wanting, thinking) 
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Appendix B 

Coding system 2: Categories, subeategories, and properties used for 
coding children’s expressions 


Category Subcategory Properties (and _ 

_relations)_P/F/O (N)V C 


1 .(Attitude towards) 

01. Affect 

Suggesting 

School activities 


Preferring 

Rejecting 

Assigning 

Revealing 


02. Cognition 

Demonstrating 

Commenting 

Questioning 

Narrating 


03. Behavior 

Collaborating 

Postulating 

Showing 

2. Classroom organization 

04. Adoption 

Following 

Accepting 

Imposing 


05. Modification 

Ignoring 

Adjusting 

Opposing 

i / r / a 

3. Teacher’s roles 

06. Instructor 

Obliging 

Learning 

Adding 


07. Facilitator 

Initiating 

Assisting 

According 


08. Educator 

Mediating 
Attending 
Complimenting 
Correcting 
Passing on 

Care taking 


09. Cultural 

Conveying 


Mediator 

Exchanging 
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Note. A relational component, or a combination of relational components, can be 
added to all the properties for: P (Peers) / F (Family) / O (Other(s), including the 
researcher, but not the own teacher of the child). 

(N)V: (non) verbal. C: Conation (feeling, wanting, thinking). The kind of the child’s 
expression, in relation to his teacher, is added to the properties in Category 3 by: i 
(in interaction with), r (in the role of), or a (about, without the teacher being 
present). 



